Understanding the Bethe approximation: when and how does it go wrong?
نویسندگان
چکیده
Belief propagation is a remarkably effective tool for inference, even when applied to networks with cycles. It may be viewed as a way to seek the minimum of the Bethe free energy, though with no convergence guarantee in general. A variational perspective shows that, compared to exact inference, this minimization employs two forms of approximation: (i) the true entropy is approximated by the Bethe entropy, and (ii) the minimization is performed over a relaxation of the marginal polytope termed the local polytope. Here we explore when and how the Bethe approximation can fail for binary pairwise models by examining each aspect of the approximation, deriving results both analytically and with new experimental methods.
منابع مشابه
Understanding the Bethe Approximation: When and How can it go Wrong?
Belief propagation is a remarkably effective tool for inference, even when applied to networks with cycles. It may be viewed as a way to seek the minimum of the Bethe free energy, though with no convergence guarantee in general. A variational perspective shows that, compared to exact inference, this minimization employs two forms of approximation: (i) the true entropy is approximated by the Bet...
متن کاملNew Understanding of the Bethe Approximation and the Replica Method
In this thesis, new generalizations of the Bethe approximation and new understanding of the replica method are proposed. The Bethe approximation is an efficient approximation for graphical models, which gives an asymptotically accurate estimate of the partition function for many graphical models. The Bethe approximation explains the well-known message passing algorithm, belief propagation, whic...
متن کاملترکش گلوئون به چارمونیوم برداری J/psi با در نظر گرفتن اثر تابع موج مزون
Studying the production or decay processes of heavy quarkonia (the bound state of heavy quark-antiquark) is a powerful tool to test our understanding of strong interaction dynamics and QCD theory. Fragmentation is the dominant production mechanism for heavy quarkonia with large transverse momentum. The fragmentation refers to the production process of a parton with high transverse momentum whic...
متن کاملHow to define ‘Moral Realism’
Moral realism is the doctrine that some propositions asserting that some action is ‘morally’ good (obligatory, bad, or wrong) are true. This paper examines three different definitions of what it is for an action to be ‘morally’ good (with corresponding definitions for ‘morally’ obligatory, bad, or wrong) which would make moral realism a clear and plausible view. The first defines ‘morally good ...
متن کاملApproximating the Bethe Partition Function
When belief propagation (BP) converges, it does so to a stationary point of the Bethe free energy F , and is often strikingly accurate. However, it may converge only to a local optimum or may not converge at all. An algorithm was recently introduced by Weller and Jebara for attractive binary pairwise MRFs which is guaranteed to return an !-approximation to the global minimum of F in polynomial ...
متن کامل